Deep Temporal Contrastive Clustering
نویسندگان
چکیده
Recently the deep learning has shown its advantage in representation and clustering for time series data. Despite considerable progress, existing approaches mostly seek to train neural network by some instance reconstruction based or cluster distribution objective, which, however, lack ability exploit sample-wise (or augmentation-wise) contrastive information even higher-level (e.g., cluster-level) contrastiveness discriminative clustering-friendly representations. In light of this, this paper presents a temporal (DTCC) approach, which first time, our knowledge, incorporates paradigm into research. Specifically, with two parallel views generated from original their augmentations, we utilize identical auto-encoders learn corresponding representations, meantime perform incorporating k-means objective. Further, levels are simultaneously enforced capture instance-level cluster-level information, respectively. With loss auto-encoder, loss, losses jointly optimized, architecture is trained self-supervised manner result can thereby be obtained. Experiments on variety datasets demonstrate superiority DTCC approach over state-of-the-art. The code available at https://github.com/07zy/DTCC .
منابع مشابه
Deep Temporal Clustering : Fully Unsupervised Learning of Time-Domain Features
Unsupervised learning of time series data, also known as temporal clustering, is a challenging problem in machine learning. Here we propose a novel algorithm, Deep Temporal Clustering (DTC), to naturally integrate dimensionality reduction and temporal clustering into a single end-to-end learning framework, fully unsupervised. The algorithm utilizes an autoencoder for temporal dimensionality red...
متن کاملDisambiguating temporal-contrastive connectives for machine translation
Temporal–contrastive discourse connectives (although, while, since, etc.) signal various types of relations between clauses such as temporal, contrast, concession and cause. They are often ambiguous and therefore difficult to translate from one language to another. We discuss several new and translation-oriented experiments for the disambiguation of a specific subset of discourse connectives in...
متن کاملLearning Deep Energy Models: Contrastive Divergence vs. Amortized MLE
We propose a number of new algorithms for learning deep energy models from data motivated by a recent Stein variational gradient descent (SVGD) algorithm, including a Stein contrastive divergence (SteinCD) that integrates CD with SVGD based on their theoretical connections, and a SteinGAN that trains an auxiliary generator to generate the negative samples in maximum likelihood estimation (MLE)....
متن کاملTemporal Clustering
We study the problem of clustering sequences of unlabeled point sets taken from a common metric space. Such scenarios arise naturally in applications where a system or process is observed in distinct time intervals, such as biological surveys and contagious disease surveillance. In this more general setting existing algorithms for classical (i.e. static) clustering problems are not applicable a...
متن کاملDeep generative-contrastive networks for facial expression recognition
As the expressive depth of an emotional face differs with individuals, expressions, or situations, recognizing an expression using a single facial image at a moment is difficult. One of the approaches to alleviate this difficulty is using a video-based method that utilizes multiple frames to extract temporal information between facial expression images. In this paper, we attempt to utilize a ge...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Processing Letters
سال: 2023
ISSN: ['1573-773X', '1370-4621']
DOI: https://doi.org/10.1007/s11063-023-11287-0